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^ ■ Abstract 
^ ■ 

' This paper studies properties of q-Jacobi polynomials and their duals by means of 

operators of the discrete series representations for the quantum algebra L'q(sui_i). Spectra 

' and eigenfunctions of these operators are found explicitly. These eigenfunctions, when 

P— i, normalized, form an orthonormal basis in the representation space. The initial C/g(sui,i)- 

' basis and the bases of these eigenfunctions are interconnected by matrices, whose entries 

, are expressed in terms of little or big g-Jacobi polynomials. The orthogonality by rows 

• ' in these unitary connection matrices leads to the orthogonality relations for little and 

, big q-Jacobi polynomials. The orthogonality by columns in the connection matrices leads 

' to an explicit form of orthogonality relations on the countable set of points for 3^2 and 

^ , 301 polynomials, which are dual to big and little g-Jacobi polynomials, respectively. The 
orthogonality measure for the dual little q-Jacobi polynomials proves to be extremal, 

, whereas the measure for the dual big g-Jacobi polynomials is not extremal. 
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^ ■ 1. Introduction 

■ The appearance of quantum groups and quantized universal enveloping algebras (quantum 

H ' algebras) and development of their representations led to their applications in the theory of 

^ I (7-orthogonal polynomials and (^-special functions (see, for example, [1-4]). Since the theory 

of quantum groups and their representations is much more complicated than the Lie theory, 
the corresponding applications are more difficult. At the first stage of such applications, the 
5^ I compact quantum groups and their finite dimensional representations have been used. 

It is known that representations of the noncompact Lie group SU{1, 1) ~ SL{2,M) are very 
productive for the theory of orthogonal polynomials and special functions (see, for example, 
[5], Chapter 7). Unfortunately, there are difficulties with a satisfactory definition of the 
noncompact quantum group SUq{l, 1), which would give us a possibility to use such quantum 
group extensively for deeper understanding the theory of orthogonal polynomials and special 
functions. For this reason, representations of the corresponding quantum algebra C/q(sui^i) 
have been commonly used for such purposes (see, for example, [6-12]). 

In this paper we continue to use representations of the positive discrete series of the quan- 
tum algebra C/g(sui^i) for exploring properties of (7-orthogonal polynomials [6-8]. In fact, we 
deal with certain operators in these representations and do not touch the Hopf structure of 
the algebra C/g(sui^i). Our study of these polynomials is related to representation operators, 
which can be represented by a Jacobi matrix. Namely, we consider those representation oper- 
ators A, which correspond to some particular Jacobi matrices. In the case under discussion we 
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diagonalize these selfadjoint bounded operators with the aid of big or Httle g-Jacobi polyno- 
mials. An explicit form of all eigenfunctions of these operators is found. Since the spectra are 
simple, eigenfunctions of each such operator form an orthogonal basis in the representation 
space. One can normalize this basis. This normalization is effected by means of the second 
operator J, which is related (in some sense) to g-difference equations for little and big g-Jacobi 
polynomials. As a result of the normalization, for each operator A (one of them is related 
to little g-Jacobi polynomials and another one to big g-Jacobi polynomials) two orthonormal 
bases in the representation space emerge: the canonical (or the initial) basis and the basis of 
eigenfunctions of the operator A. They are interrelated by a unitary matrix U whose entries 
Umn are explicitly expressed in terms of little or big g-Jacobi polynomials. Since the matrix 
U is unitary (and in fact it is real in our case), there are two orthogonality relations for its 
elements, namely 



The first relation expresses the orthogonality relation for little or big g-Jacobi polynomials. 

So, the orthogonality of U yields an algebraic proof of orthogonality relations for these polyno- 
mials. In order to interpret the second relation, we consider little and big g-Jacobi polynomials 
PniQ^™') as functions of n. In this way one obtains two sets of orthogonal functions (one for 
little g-Jacobi polynomials and another for big g-Jacobi polynomials), which are expressed 
in terms of g-orthogonal polynomials (which can be considered as a dual sets of polynomials 
with respect to little and big g-Jacobi polynomials; such duality is well known in the case of 
polynomials, orthogonal on a finite set of points). The second relation in (1.1) leads to the 
orthogonality relations for these g-orthogonal polynomials on nonuniform lattices. 

In fact, this idea extends the notion of the duality of polynomials, orthogonal on a finite set, 
to the case of polynomials, orthogonal on an infinite set of points. We have already used this 
idea in [6] and [8] to show that Al-Salam-Carlitz II polynomials are dual with respect to little 
g-Laguerre polynomials and g-Meixner polynomials are dual to big g-Laguerre polynomials. 
We emphasize at this point that there are known theorems on dual orthogonality properties 
of g-polynomials, whose weight functions are supported on a discrete set of points (see, for 
example, [13] and [14]). However, they are formulated in terms of orthogonal functions (see 
(5.1) and (8.1) below for their explicit forms in the case of little and big g-Jacobi poljmomials, 
respectively) as dual objects with respect to given orthogonal polynomials. Therefore, one 
still needs to make one step further in order to single out an appropriate family of dual 
polynomials from these functions. So, our main motivation for this paper is to show explicitly 
how to accomplish that for little and big g-Jacobi polynomials. 

The orthogonality measure for polynomials, dual to little g-Jacobi polynomials, is ex- 
tremal, that is, these polynomials form a complete set in the space with respect to their 
orthogonality measure. 

The orthogonality measure for polynomials, dual to big g-Jacobi polynomials, is not ex- 
tremal: these polynomials do not form a complete set in the corresponding space L^. We 
have found the complementary set of orthogonal functions in this space L^. These functions 
are expressed in terms of the same polynomials but with different values of parameters. 

The dual little g-Jacobi polynomials and the dual big g-Jacobi polynomials, as other well- 
known g-orthogonal polynomials, can be applied in different branches of science. For example, 
they may be useful for studying a certain type of g-difference equations, which appear in 
applications in engineering and physics. 

Throughout the sequel we always assume that g is a fixed positive number such that g < 1. 
We use (without additional explanation) notations of the theory of special functions and the 
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standard ^-analysis (see, for example, [15] and [16]). In particular, we adopt for g-numbers 
[a]q the form 

where a is any complex number and g^/^ is assumed to be positive. We shall also use the 
well-known shorthand (ai, • • • , a^; g)„ := (ai; g)„ • • • (o^; 

2. Discrete series representations of ?7q(sui i) 

The quantum algebra Uq{sui^i) is defined as the associative algebra, generated by the 
elements J+, J_, q-^o and subject to the commutation relations 

qJoq-Jo = q-JoqJo = qJoj^ q-Jo = q±lj^^ = ~ , 

and the involution relations (g"'")* = g'^° and = J_. (Observe that here we have replaced 
J_ by — J- in the common definition of the algebra J7g(sl2).) For brevity, in what follows we 
denote the algebra ?7g(sui,i) by sUg(l, 1). 

If the algebra sug(l, 1) is realized in terms of the operators, one may consider also the 
operator Jq. In this case instead of the commutation relations between J_|_, J_, q'^'^ and q~'^°, 
it is convenient to work with more familiar relations 

[Jo,J±]=±J±, [J-,J+] ^ ^ 



ql/2 _q-l/2- 

Then the involution relations reduce to the following ones: 

Jo* = Jo, r+ = J-. (2.1) 

We are interested in the discrete series representations of SU5(1, 1) with lowest weights. 
These irreducible representations will be denoted by T^, where I is a lowest weight, which 
can be any positive number (see, for example, [17]). 

The representation can be realized on the space Ci of all polynomials in x. We choose 
a basis for this space, consisting of the monomials 



/^(x) :=ct,x", n = 0,1,2,- ••, (2.2) 

where 

<4 = 1. 'i = n '"".'v."''' = , n = 1, 2, 3, . . . , (2.3) 

k=i [k\q {q; q)n 

and (a; q)n = (1 — a)(l — aq) ... (1 — aq^~^). The representation is then realized by the 
operators 

^0 = 2;— + /, J± = x^^[Jq{x) ±l]q . 



As a result of this realization, we have 

l-q 



J+ fl = ^[21 + n]q [n + l]q = — ^(1 - r+i)(l - q^^+-)fUi, (2-4) 
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J_ fl = ^[21 + n - 1], [n], = ^ ^_ - - (2.5) 



-(n+Z-3/2)/2 

^o/^ = (/ + n)/^ (2.6) 



We know that the discrete series representations Ti can be reahzed on a Hilbert space, on 
which the adjointness relations (2.1) are satisfied. In order to obtain such a Hilbert space, 
wc assume that the monomials /^(x), n = 0, 1, 2, • • •, constitute an orthonormal basis for this 
Hilbert space. This introduces a scalar product (•,•) into the space Ci. Then we close this 
space with respect to this scalar product and obtain the Hilbert space, which will be denoted 
hjHi. 

The Hilbert space Hi consists of functions (series) 

oo oo oo 

n=0 n=0 n=0 

where a„ = 6„cJ,. Since (/^, = 5,„n\yy definition, for f{x) = Y1'^=q o-nx'' and f'{x) = 
^J^qO^x" we have {f,f') = Z]5^=o '^'i '^n/knP' that is, the Hilbert space Tii consists of 
analytical functions f{x) = Yl'^=o x'^ , such that = J2'^=o I'^n/cii]^ < oo. 

3. Leonard pair {h,J) 

Let Ii be the operator 

:= -aq^°/^{J+ A + A J.)^-^"/^ + B (3.1) 

of the representation T^, where a = (a/g)^/^ (1 — q), a = q^^~^ , and A and B are operators 
of the form 



A. 



qJo-l /(l-ag-^o-'+i)(l-a6g-^o-'+i) (I - q''^-^){l - bq^^'^) 
B = rr-^ — ^TTTT : r";77 — ?rrn^ 1" o- 



^ a6g2Jo-2/+l \^ 1 _ (j^lq2Jo-2l+2 I _ q5^2Jo-2/ 

Since the bounded operator q'^° is diagonal in the basis {/^}, the operators A and B are well 
defined. 

We have the following expression for the action of the operator Ii in the canonical basis 
n = 0,1,2, 

-^1 /n = -C-nfn+l " On-l/n-l + Kfi, (3.2) 

where 

^ ^ ^1/2 n+1/2 V(l - - Qg"+^)(1 - feg"+^)(l ~ g^g"^ 

^ (1 - a6g2n+2)^(i _ a6g2"+i)(l - a6g2n+3) ' 

g" |^ (l-ag"+^)(l-abg"+^) (1 - g")(l - 5g") 



1 - ahq^''+^ \ 1 - a?)g2"+2 1 - a6g2" 

In order to assure that expressions for a„ and 6„ arc well defined, wc suppose that h < g~^. 
Note that < a = g2^~^ < and I takes any positive value. Since the g^"'" are symmetric 
operators, the operator /i is also symmetric. 

Since ^ and 6„ — > when n — ^ oo, the operator Ii is bounded. Therefore, wc assume 
that it is defined on the whole representation space Hi- For this reason, /i is a selfadjoint 
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operator. Let us show that Ii is a trace class operator (we remind that a bounded selfadjoint 
operator is a trace class operator if a sum of its matrix elements in an orthonormal basis is 
finite; a spectrum of such an operator is discrete, with a single accumulation point at ). For 
the coefficients a„ and 6„ from (3.2), we have 

an+i/cLn q, bn+i/bn q when n ^ oo. 

Therefore, for the sum of all matrix elements of the operator Ii in the canonical basis we have 
^„(2a„ + bn) < oo. This means that Ii is a trace class operator. Thus, a spectrum of Ii 

is discrete and have a single accumulation point at 0. Moreover, a spectrum of Ii is simple, 
since Ii is representable by a Jacobi matrix with a„ ^ (see [18], Chapter VII). 
To find eigenfunctions (,x{x) of the operator Ii, Ii^xi^) = '^^x{x), we set 



n=0 

Acting by the operator Ji upon both sides of this relation, one derives that 

oo oo 



I 

n' 

ra=0 n=0 



where a„ and 6„ are the same as in (3.2). Collecting in this identity all factors, which multiply 
with fixed n, one derives the recurrence relation for the coefficients /9n(A): 

/3„+i(A)a„ + /3„_i(A)a„_i - /3n(A)6n = -A/3„(A). 

Making the substitution 

^-^^^-\{bq^q-q)^{l-abq){acir) ^"^^^ 
reduces this relation to the following one 

^n/3;+i(A) + C„/3;_i(A) - {A^ + CMX) = -A/3;(A) 

with 

_ g"(l - ag"+i)(l - a6g"+^) _ ag"(l - g")(l - 6g") 



(1 - a6g2n+i)(l - a6g2n+2) ' " (1 - a6g2«)(i _ a5g2n+i) ' 
This is the recurrence relation for the little (/-Jacobi polynomials 

Pn{\;a,b\q) := 24>iiq~"',abq"-'^^; aq; q,qX) (3.3) 

(see, for example, formula (7.3.1) in [15]). Therefore, /3^(A) = Pn{X;a,b\q) and 



a f.^ ( {abq,aq;q)n{l - ahq^'''^^) \ . 

For the eigenfunctions ^,\{x) we have the expression 

c t \ /(a6g,ag;g)„(l-a6g2"+i)y/2 m ^ ^ 

^ V {bq,q\q)n{l-abq){aqY J 



(3.4) 
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oo 



74 (ag;g)n / {abq;q)n (1 - a6g^"+^) \ 
(g; g)„ \{bq;q)n{l- abq) {aq^ ) 



— n 



p„(A;a,6|g)x". 



(3.5) 



ra=0 



Since the spectrum of the operator Ii is discrete, only a discrete set of these functions belongs 
to the Hilbert space Hi- This discrete set of functions determines a spectrum of Ii. 

Now we look for a spectrum of the operator Ii and for a set of polynomials, dual to the 
little g-Jacobi polynomials. To this end we use the action of the operator 



upon the eigenfunctions £,\{x), which belong to the Hilbert space Tii. In order to find how 
this operator acts upon these functions, one can use the g-difference equation 



(g-'^ + a6(?"+i) p„ (A) = a\-\bq\ - 1) Pn (qX) + + a) + \-\\ - 1) Pn A) (3.6) 



for the little g'-Jacobi polynomials Pn(A) = Pn{X',a,b\q) (see, for example, formula (3.12.5) in 
[19]). Multiply both sides of (3.6) by d„ //,(x) and sum up over n, where dn are the coefficients 
oi Pn{X;a,b\q) in the expression (3.4) for the coefficients (3n{X). Taking into account the first 
part of formula (3.5) and the fact that Jf^ix) = {q~^ + abq"'^^) f!j^{x) , one obtains the relation 



It will be shown in the next section that the spectrum of the operator Ii consists of the 
points A = g", n = 0, 1,2, • • •. Thus, we see that the pair of the operators Ii and J form a 
Leonard pair (see [20], where P. Terwilliger has actually introduced this notion in an effort to 
interpret the results of D. Leonard [21]). Recall that a pair of operators Ri and R2, acting in 
a linear space C, is a Leonard pair if 

(a) there exists a basis in C, with respect to which the operator Ri is diagonal, and the 
operator R2 has the form of a Jacobi matrix; 

(b) there exists another basis of C, with respect to which the operator R2 is diagonal, and 
the operator Ri has the form of a Jacobi matrix. 

Properties of Leonard pairs of operators in finite dimensional spaces are studied in de- 
tail (see, for example, [22] and [23]). Leonard pairs in infinite dimensional spaces are more 
complicated and only some isolated results are known in this case (see, for example, [23]). 

4. Spectrum of Ii and orthogonality of little g'-Jacobi polynomials 

The aim of this section is to find, by using the Leonard pair (/i, J), a basis in the Hilbert 
space Hi, which consists of eigenfunctions of the operator Ii in a normalized form, and to 
derive explicitly the unitary matrix U, connecting this basis with the canonical basis 
n = 0, 1,2, in Hi. This matrix directly leads the orthogonality relation for the little 
g-Jacobi polynomials. 

A word of explanation is in order. It is a well-known fact that the little g-Jacobi polynomi- 
als (3.3) represent a particular case of the big g-Jacobi polynomials (see formula (6.3) below) 
with the vanishing parameter c. Therefore, it may seem that one should start directly with 
the latter set of polynomials - wherein the corresponding results for the former family (3.3) 
are then recovered by assuming that c = 0. However, we are interested in finding dual families 
with respect to polynomials (3.3) and (6.3), and establishing their properties. It turns out 
that an interrelation between dual little g-Jacobi and dual big g-Jacobi polynomials is more 
intricate than that occurring between polynomials (3.3) and (6.3) themselves (for instance. 



J^xix) = aX-\bqX - 1) e,A(x) + X-\l + a) ^x{x) + A-^(A - 1) ^g-ix{x). 



(3.7) 
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the orthogonality measure for dual little g-Jacobi polynomials proves to be an extremal one, 
whereas the orthogonality measure for dual big g-Jacobi polynomials is not extremal). For 
this reason we find it more instructive to begin our discussion with the simpler case (3.3) in 
this section and then to consider duals of the polynomials (6.3) in sections 6-8. 

Let us analyze a form of the spectrum of the operator Ii from the point of view of the 
representations of the algebra suq(l, 1). If A is a spectral point of the operator Ii, then (as it is 
easy to see from (3.7)) a successive action by the operator J upon the function (eigenfunction 
of /i) leads to the functions 

Cq-A, m = 0,±l,±2,---. (4.1) 

However, since /i is a trace class operator, not all these points can belong to the spectrum of 
Ii, since g^™A oo when m — ^ oo if A 7^ 0. This means that the coefficient A' — 1 of ^,q~iy{x) 
in (3.7) must vanish for some eigenvalue A'. Clearly, it vanishes when A' = 1. Moreover, this 
is the only possibility for vanishing a coefficient at Cq-iA'(^) (3-7), that is, the point A = 1 
is a spectral point for the operator /i. Let us show that the corresponding eigenfunction 
^i(x) = ^qo(x) belongs to the representation space TCi. 

Observe that by formula (n.6) of Appendix II in [15], one has 

Pn{l;a,b\q) = 20i(g-",a6Q"+^ aq; q,q) = (^"'g""; g)n ^^^^n+iy»_ 

im; q)n 

Since (6~V~";g)n = (6g; g)n(-6~^9~^)"g~"^"~^^/^, this means that 



Therefore, 



Pn{l;a,b\q) = ^^^{-arq<-+'y\ 

^ (bq, q; q)n (l - abq){aqY 

^ {abq,bq;q)n (1 - a6g^"+^) ^„ „2 ^ (a5g^;g)oo 
{aq,q;q)n{^- abq) iaq;q)oo 

The last leg of this equality is obtained from formula (A.l) of Appendix. Thus, the series (4.2) 
converges and, therefore, the point A = 1 actually belongs to the spectrum of the operator Ii. 

Let us find other spectral points of the operator Ii (recall that a spectrum of Ii is discrete). 
Setting A = 1 in (3.7), we see that the operator J transforms ^qo(x) into a linear combination 
of the functions ^g(x) and ^go(x). Moreover, Cq{x) belongs to the Hilbert space Hi, since the 
series 

/£ t\ ^ i(ibq,aq;q)n{l- abq'^''+'^) ^ 
[bq,q;q)n (l - abq){aqy' 

is majorized by the corresponding series for ^^^0(2;), considered above. Therefore, ^q{x) belongs 
to the Hilbert space Hi and the point q is an eigenvalue of the operator Ii. Similarly, setting 
A = g in (3.7), we find that ^g2{x) is an eigenfunction of Ii and the point g^ belongs to the 
spectrum of /i. Repeating this procedure, we find that ^yn(.T), n = 0, 1, 2, • • •, are eigenfunc- 
tions of Ii and the set g"^, n = 0, 1, 2, • • •, belongs to the spectrum of Ii. So far, we do not 
know yet whether other spectral points exist or not. 

The functions ^gn(x), ra = 0, 1, 2, • ■ •, are linearly independent elements of the representa- 
tion space Hi (since they correspond to different eigenvalues of the selfadjoint operator Ii). 
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Suppose that values g"^, n = 0, 1, 2, • • •, constitute a whole spectrum of the operator Ii. Then 
the set of functions ^gn(x), n = 0, 1, 2, • • •, is a basis in the Hilbert space Hi- Introducing the 
notation := ^qn{x), n = 0, 1, 2, • • •, we find from (3.7) that 

JS„ = -aq-^'il - bq''+') E^+i + g-"(a + 1) H„ - - q^) (4.3) 

As we see, the matrix of the operator J in the basis H„, n = 0, 1, 2, • • •, is not symmetric, 
although in the initial basis n = 0,1,2,- ■■, it was symmetric. The reason is that the 
matrix {amn) with entries 

amn-=(3mW), m,n = 0,1,2, ■■■ , 

where Pmil"') are the coefficients (3.4) in the expansion ^gi(x) = Pm{Q"') fki^) ^ is not 
unitary. It is equivalent to the statement that the basis H„ := .^gi(x), n = 0, 1, 2, • • •, is not 
normalized. To normalize it, one has to multiply S„ by corresponding numbers (which are 
not known at this moment). Let = Cn'^n, n = 0, 1, 2, • • •, be a normalized basis. Then the 
matrix of the operator J is symmetric in this basis. Since J has in the basis the form 

JS„ = -c-l.Cnaq-'^il - bq''+') + q'^ia + 1) - c;\c„g-"(l - g") (4.4) 

then its symmetricity means that 

c-l,Cnaq-^{l - bq^+') = c'' Cn+iq-^-\l - q^+') , 



that is, Cn/cn-i = ^y aq{l — hq^)/{l — g"). Therefore, 

Cn = c{aqT'^ 



{bq; g)y^ 
1/2 ■ 



where c is a constant. 
The expansions 

m 

connect two orthonormal bases in the representation space Hi. This means that the matrix 
{0"mn), m,n = 0,1,2,- ■ ■, with entries 

/ nx ff ^n-m ih', q)n {abq, aq; q)m (1 - abq'^'^+^) \ u\ \ tA r\ 

is unitary, provided that the constant c is appropriately chosen. In order to calculate this 
constant, we use the relation Ylm=o l^mnP = 1 for n = 0. Then this sum is a multiple of the 
sum in (4.2) and, consequently, 

{aq; qfJ^ 

{abq; q)]^ 

Thus the in (4.5) and (4.6) is real and equals to 



The matrix (a^n) is orthogonal, that is, 



Substituting into the first sum over n in (4.7) the expressions for a^„, we obtain the identity 

(^ — nhn\(nn\^ (hn n-nV.. 

(4.8) 



{bq:q)„{aqy 

j—^ p^(g ;a,6|g)p^/(gr ;a,fe|gr) 

n=0 

{abq'^;q)oo {I - ahq){aq)"' {hq,q;q\ 



{aq;q)oo {l- abq^'^+'^){abq,aq;q)m 

which must yield the orthogonality relation for the little qf-Jacobi polynomials. An only gap, 
which appears here, is the following. We have assumed that the points q", n = 0, 1, 2, • ■ •, 
exhaust the whole spectrum of the operator Ii. Let us show that this is the case. 

Recall that the selfadjoint operator Ii is represented by a Jacobi matrix in the basis 
fn{x), n = 0, 1, 2, • • •. According to the theory of operators of such type (see, for example, 
[18], Chapter VII), eigenfunctions of Ji are expanded into series in the monomials /^(x), 
n = 0, 1, 2, • • •, with coefficients, which are polynomials in A. These polynomials arc orthogonal 
with respect to some positive measure ci//(A) (moreover, for selfadjoint operators this measure 
is unique). The set (a subset of M), on which the polynomials are orthogonal, coincides with 
the spectrum of the operator under consideration and the spectrum is simple. Let us apply 
these assertions to the operator Ii. 

We have found that the spectrum of Ii contains the points g", = 0,1,2, If the 
operator Ji would have other spectral points x, then on the left-hand side of (4.8) there would 
be other summands iJ,x^. Pm{xk'i o-, b\q) Pm' i^k'i o.-, b\q)-, corresponding to these additional points. 
Let us show that these additional summands do not appear. To this end we set m = m' = in 
the relation (4.8) with the additional summands. Since ^0(2;; o, h\q) = 1, we have the equality 

{bq;q)n{aqT _ {abq'^;q)oo 

According to the g-binomial theorem (see formula (1.3.2) in [15]), we have 

y> {bq; q)n {aqT ^ {abq^;q)oo 
^ {q\q)n {aq;q)oo 

Hence, Ylkl^^k — ^ ^^"^ l^x^ disappear. This means that additional summands do not 
appear in (4.8) and it does represent the orthogonality relation for the little g-Jacobi polyno- 
mials. 

By using the operators Ii and J, which form a Leonard pair, we thus derived the orthog- 
onality relation for little g-Jacobi polynomials. 

The orthogonality relation for the little g- Jacobi polynomials is given by formula (4.8). 
Due to this orthogonality, we arrive at the following statement: The spectrum of the operator 
I\ coincides with the set of points q^, n = 0, 1,2,---. The spectrum is simple and has one 
accumulation point at 0. 

5. Dual little g-Jacobi polynomials 
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Now we consider the second identity in (4.7), which gives the orthogonahty relation for 
the matrix elements amn, considered as functions of m. Up to multiplicative factors these 
functions coincide with the functions 

Fnix]a,b\q) = 2(f)iix,abq/x] aq; g""*"^), (5.1) 

considered on the set x € {q~^ | m = 0, 1, 2, • • •}. Consequently, 

. ( (ag;g)oo ipq- q)n ,.n-m (g&g, gg; g)^ (i - Q^g^'"+^) ^ ^''^ ^ ,-m. ^ , , x 

\{abq;q)oo W,q)n {bq,q;q)m J 

and the second identity in (4.7) gives the orthogonality relation for the functions (5.1): 

\ il-ahq)iaa)-ibq.q;q)^. ^"^^ '«'%)^"'(^ ' %) 



m=0 



{abq^;q)oo{q;q)n{aq) " , . 

= —, X 77 N Kn'- (5.2) 

{aq\ g)oo (og; g)„ 

The functions Fn{x\a,b\q) can be represented in another form. Indeed, one can use the 
relation (III. 8) of Appendix III in [15] in order to obtain that 

F„(g-™;a,6|g) = g)"- (a6g-+^)-3</>i(g-", a5g-+\ g""; 5g; g,g7a) 

^ (-l)"'(^g;g)m ^™ ^m{m+i)/2^^ o6g"'+\ g-"; 6g; g, g'Va). (5.3) 

(ag; g)m 

The basic hypergeometric function 3(^)1 in (5.3) is a polynomial of degree n in the variable 
\x{ra) := g""* + abq^~^^, which represents a g-quadratic lattice; we denote it 

dMm);a,b\q) := sMq'"" , o,b q^+\ q-^ ; bq; q^q'^/a). (5.4) 

Then formula (5.2) yields the orthogonality relation 



m=0 



^ (1 - a6g2™+^)(a6g,6g;g)^ m , . . , . . 
(l-a6g)(ag,g;g)^, ° ^ d„(Mm)) 



(a6g2;g)cx) (g;g)n(ag) " 

= —f X 77 X (>nn' (5.5) 

{aq; q)oo {bq; q)n 

for the polynomials (5.4). We call the polynomials dnip-im); a,b\q) dual little q-Jacobi poly- 
nomials. Note that these polynomials can be expressed in terms of the Al-Salam-Chihara 
polynomials 



r> f u \ i(^b;q)n , (q "■,az,az ^ 
Qn{x;a,b\q) = — 302 



ab, 

with the parameter g > 1. An explicit relation between them is 



1/ -In 
x = -{z + z ), 



dn{l^{x)\ 13 / a, l/al3q\q) = a^n^M n \ Qn{oil^{x)/2]a,^\q~^). 

{-Pr{i-/ap; q)n 
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Ch. Berg and M. E. H. Ismail studied this type of Al-Salam-Chihara polynomials in [24] 
and derived continuous complex orthogonality measures for them. But [24] does not contain 
any discussion of the duality of this family of polynomials with respect to little g-Jacobi 
polynomials. 

A recurrence relation for the polynomials dn(n(m);a,b\q) is derived from formula (3.6). 
It has the form 

(g-™ + a^g'^+i) d„(/i(m)) = -a g-"(l - 6^"+^) d„+i(^(m)) 

+ g-"(l + a) d„(/i(m)) - g-(l - g") d„_i(/i(m)), 

where dn{l-t{m)) = (i„(/[i(m); a, 6|g). Comparing this relation with the recurrence relation 
(3.69) in [25], we see that the polynomials (5.4) are multiple to the polynomials (3.67) in [25]. 
Moreover, if one takes into account this multiplicative factor, the orthogonality relation (5.5) 
for polynomials (5.4) turns into relation (3.82) for the polynomials (3.67) in [25], although 
the derivation of the orthogonality relation in [25] is more complicated than our derivation of 
(5.5). The authors of [25] do not give an explicit form of their polynomials in the form similar 
to (5.4). Concerning the polynomials (3.67) in [25] see also [26]. 

Let P be the Hilbert space of functions on the set m = 0, 1, 2, • • • with the scalar product 

/f t\ (1 - a6g2™+i) (a6g,6g;g)m m . / x-rr^ 

The polynomials (5.4) are in one-to-one correspondence with the columns of the unitary matrix 
(dmn) and the orthogonality relation (5.5) is equivalent to the orthogonality of these columns. 
Due to (4.7) the columns of the matrix (dmn) form an orthonormal basis in the Hilbert space 
of sequences a = {a„ | n = 0, 1, 2, • • •} with the scalar product (a, a') = ana[^. For this 
reason, the set of polynomials dndj^^m); a, b\q), n = 0, 1, 2, • • •, form an orthogonal basis in the 
Hilbert space P. This means that the point measure in (5.5) is extremal for the dual little 
q-Jacobi polynomials dnifJ-im); a, b\q) (for the definition of an extremal orthogonality measure 
see, for example, [27]). 

6. Pair of operators {I2,J) 

Let b and c be real numbers such that < 6 < g^^ and c < 0. We consider the operator 

h := a g'^°/^( J+ A + AJ_) g-'o/^ - B (6.1) 

of the representation Tj^, where a = {—acjqf-l'^ (1 — g), a = g^'~^, and A and B are operators 
of the form 

_ g^-^°~^+^^/^\/(r~- 6g-^"-'+^)(l - a6g'^»-'+^)(l - cg-^»-'+i)(l - abc-^ q^^-^^^) 
~ (1 - a6g2-^o-2'+2)y(l - a6g2-^o-2'+i)(l - abq'^'^o-21+3^ ' 

^ (1 - ag-^o-'+^) (1 - a6g-^''-'+^) (1 - cq-^°-^+^) 
B = — 



-acq 



(1 - a6g2-^o-2;+i)(i _ abq^Jo-2l+2^ 
J0-/+1 (1 - g-^°-')(l - 6g-^°-0(l - a6c-ig^o-') 



(1 _ a6g2Jo-2«)(l _ a^g2J„-2/+l) 

We have the following formula for the symmetric operator I2'. 

h fn = «n/n+l + «n-l/Ll - &n/^, (6.2) 
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where 

a _ = f-ac "+i)V2 V(l - - - - Q&g") (1 - cg")(l - a6c-ig^ 

(1 - a,7"+i)(l - o6g"+i)(l - cg"+i) „+i (1 - - - a6g"/c) 

"~ (l-a6g2n+i)(i_a5^2n+2-) "'^^ (1 - a6g2n)(l - a6g2n+i) ' 

with o = g2'-i. Recall that / takes any positive value, so a can be any positive number such 
that a < q~^. Since the gr^'^" are symmetric operators, the operator I2 is also symmetric. 

The operator I2 is bounded. Therefore, we assume that it is defined on the whole repre- 
sentation space Hi. This means that I2 is a selfadjoint operator. Actually, I2 is a trace class 
operator. To show this we note that for the coefficients a„ and 6„ from (6.2) one obtains that 

a„+i/a„ g^/^, hn+\/K ^ Q when n ^ 00. 

Therefore, X^nl^'^" + ^n) < 00 and this means that I2 is a trace class operator. Thus, the 
spectrum of I2 is simple (since it is representable by a Jacobi matrix with a„ / 0), discrete 
and have a single accumulation point at 0. 

To find eigenfunctions tp\{x) of the operator I2, htpxix) = X'tp\{x), we set 

00 

n=0 

Acting by the operator I2 on both sides of this relation, one derives that 
^/3n(A)(a„/^+i + an-ifLi - Kfn) = A^/3„(A)/^, 

n 

where o„ and 6„ are the same as in (6.2). Collecting in this identity factors, which multiply 
with fixed n, we arrive at the recurrence relation for the coefficients Pn{^)- 

Making the substitution 



{ahq, aq, cq; q)n (1 - a6Q2"+i) ^^ ^2 



V [abq/c, bq, q; q)n (1 - abq){-ac)"- J 
we reduce this relation to the following one 

AnP'n+lW + CnP'n-lW ' (^n + C„ - l)K(A) = XP'^W 

with 

_ (1 - ag"+^)(l - cg"+i)(l - a6g"+i) 



Cn — 



(1 - a6g2n+l) (1 _ abq^^+^) 
acg"+i(l - g")(l - 6q")(1 - a6c-ig^ 



(1 - a6g2n) (1 _ a6g2n+i) 
It is the recurrence relation for the big g-Jacobi polynomials 



Pn{\;a,h,c;q) := z(l)2{q ",a6g'*+\A; aq,cq; q,q) (6.3) 
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introduced by G. E. Andrews and R. Askey [28] (see also formula (7.3.10) in [15]). Therefore, 
PnW = ^n(A; a, b, c; q) and 

= ( , 7' f ■ - f f „ ) g-'-^')/^ F„(A; a, b, c; (6.4) 

\{abq/c,hq,q;q)n{l- abq){-acY J 

For the eigenfunctions ipx{x) we have the expansion 



oo 



- «-"/4 (abg,cg;g)„(l-a6g2"+i) \ ^2 ^^(^^3^/4 

"ft (^;^)" VWc,5g;g)n(l-a6g)(-ac)"; ^ /^n(A,a,6,c,g)x . 

(6.5) 

Since the spectrum of the operator I2 is discrete, only a discrete set of these functions belongs 
to the Hilbcrt space TCi and this discrete set determines the spectrum of l2- 

In what follows we intend to study a spectrum of the operator I2 and to find polynomials, 
dual to big g-Jacobi polynomials. It can be done with the aid of the operator 

J := q-Jo+l + abg-^o-i+i ^ ^^j^ _ 

which has been already used in the previous case in section 3. In order to determine how this 
operator acts upon the eigenfunctions ij^xix), one can use the g-difference equation 

{q-"" + abq^+^) Pn{X) = aqX'^X - l){bX - c) Pn{qX) 

-[X-^acq{l +q)- X~\{ab + ac + a + c)] P„(A) + X-^{X - aq){X - cq) P„(g"^A), (6.6) 

for the big g-Jacobi polynomials PniX) = Pn{X;a,b,c;q) (see, for example, formula (3.5.5) in 
[19]). Multiply both sides of (6.6) by dn fn{x), where d„ are the coefficients of Pn{X; a, b, c; q) 
in the expression (6.4) for the coefficients Pn{X), and sum over n. Taking into account formula 
(6.5) and the fact that J f!^{x) = (g"" + a6g"+^) fn{x), one obtains the relation 

JMx) = aqX-^iX -l){bX-c) ^gx{x) 

-[A"^acg(l + q)- X~^q{ab + ac + a + c)] i;x{x) + A"^(A - ag)(A - eg) ^q-ix{x). (6.7) 

It will be shown in the next section that the spectrum of the operator I2 consists of the points 
ag"", eg", n = 0, 1,2, • • •. The matrix J consists of two Jacobi matrices (one corresponds to 
the basis elements ag", n = 0, 1, 2, • • •, and another to the basis elements eg", n = 0, 1, 2, • • •). 
In this case, the operators I2 and J form some generalization of a Leonard pair. 

7. Spectrum of I2 and orthogonality of big g-Jacobi polynomials 

As in section 4 one can show that for some value of A (which must belong to the spectrum) 
the last term on the right side of (6.7) has to vanish. There are two such values of A: A = aq 
and A = eg. Let us show that both of these points are spectral points of the operator I2. 
Observe that, according to (6.3), 

P„(ag;a,6,e;g) := 20i(g-", a6g-+^ eg; g,g) = ^^l^^{abr q-(-+^) . 
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Therefore, since 
one obtains that 

Likewise, 



{c/ahq^-q)n = (a6g/c; g)„(-c/a6)>-"("+^/2 , 

P„(ag; a, 6, c; g) := (^^^Z£i^(_e)^"("+i)/^ (7.1) 
(eg; g)n 



Hence, for the scalar product {iljaq{x),il^aq{x)) we have the expression 

V (1 - (a^g, m, eg; q)n -n(n+3)/2 p2. , . 



n=0 

^ (1 - aV"+^) {abq/c, abq,aq;q)n „(„_i)/2 ^ {abq^,c/a;q)^ 
^ (1 - a6g) (6^,0(7, (-a/c)" {bq,cq;q)oo 

where the relation (A. 6) from Appendix has been used. Similarly, for {ipcq{x),ipcq{x)) one has 
the expression 

V - (^bq'^''^^){abq,aq,cq;q)n q-n(n+3)/2 p2r^^. ^^^^ ^. ^ {abq'^,a/c; q)^ ^ 
{I- abq){-ac)'' {abq/c,bq,q;q)n " ' ' ' ' {aq,abq/c;q)oo' 

where formula (A. 7) from Appendix has been used. Thus, the values \ = aq and X = cq are 
the spectral points of the operator I2. 

Let us find other spectral points of the operator I2. Setting A = ag in (6.7), we see that the 
operator J transforms ipaqix) into a linear combination of the functions ipg^q2{x) and tpaqix). 
We have to show that iljaq^{x) belongs to the Hilbert space Hi, that is, that 

{abq/c, bq, q; q)n (1 - a6g)(-ac)" 

It is harder to prove this inequality directly, than in the case of the little g-Jacobi polynomials. 
Therefore we do not want to embark on the discussion of this point here (for this inequality 
actually follows from the orthogonality relation for the big g-Jacobi polynomials). The above 
inequality shows that ipg^ij2{x) is an eigenfunction of I2 and the point aq^ belongs to the 
spectrum of the operator I2. Setting A = aq^ in (6.7) and acting similarly, one obtains that 
ij^aq^i^) is an eigenfunction of I2 and the point aq^ belongs to the spectrum of l2- Repeating 
this procedure, one sees that ipaq"{x), n = 1,2, ■ ■•, are eigenfunctions of I2 and the set aq^, 
n = 1, 2, • • •, belongs to the spectrum of I2. Likewise, one concludes that tpcq^ix), n = 1, 2, • • •, 
are eigenfunctions of I2 and the set eg", n = 1,2, • • •, belongs to the spectrum of l2- Note 
that so far we do not know whether the operator I2 has other spectral points or not. In order 
to solve this problem we shall proceed as in section 4. 

The functions tpaq"ix) and 4^cq"{x), n = 1,2,---, are linearly independent elements of 
the representation space Hi- Suppose that ag" and eg", n = 1,2,---, constitute the whole 
spectrum of the operator I2. Then the set of functions il^aq"{x) and ipcq'^{x), n = 1, 2, ■ ■ ■, is a 
basis of the Hilbert space Tii. Introducing the notations E!„ := ^agn+i(a;) and := ^f.qn+i{x), 
n = 0, 1, 2, • • •, we find from (6.7) that 

JS„ = a-^cg-2"-i(l-ag"+^)(l-6ag'^+Vc)S„+i+d„S„ + a-^eg-2'^(l-g")(l-ag'^/c)S„_i, 
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J~'^ = c-^aq-^^-\l - C(?"+i)(l - E^+i + S„ + c-^aq-^^{l - q^){l - cq^/a) H„_i, 

where 

dn = -[g~^"~^c(l + q)- q''\ab + ac + a + c)], 

d'^ = ^[g-2"-ia(l + q)- q-^'iab + ac + a + c)]. 

As we see, the matrix of the operator J in the basis E!„ = Caq"+'^{x)^ ^'n — Ccg"+i(2^)) 
n = 0, 1,2, is not symmetric, although in the initial basis n = 0, 1,2, it was 
symmetric. The reason is that the matrix M := {amn o,'mn) with entries 

amn ■= Pmiaq''), a'mn ■= Pm{cq''), m, n = 0, 1, 2, • • • , 

where Prn{dq"'), d = a,c, are coefficients (6.4) in the expansion ipdq^i^) = Pm{dq^'') fn{x) 
(see above), is not unitary. This matrix M is formed by adding the columns of the matrix 
(a^„) to the columns of the matrix {amn) from the right, that is. 



M = 



/ an • 


■ aik ■ 


■ «n • 




021 • 


■ a2k ■ 


• 41 • 




aji ■ 


■ ajk ■ 







V 



It maps the basis {fn} into the basis {V'ag^+i i V^c^^+i } the representation space. The 
nonunitarity of the matrix M is equivalent to the statement that the basis H„ := ^aqri+i[x), 
S„ := ^^gn+i{x), n = 0, 1,2, • • ■, is not normalized. In order to normalize it we have to mul- 
tiply H„ by appropriate numbers Cn and by numbers c^. Let H„ = c^H^, = c^S„, 
n = 0, 1, 2, • • •, be a normalized basis. Then the operator J is symmetric in this basis and has 
the form 



JEn = c-l,Cna-^cq-^''-Hl - a(?"+i)(l - abq^'+^/c) + d„S, 
+c-'_,Cna-'cq-^^^\l - aq^/c){l - q^) E^-i, 



; = c'-l,c'nC-'aq-^''-\l - bq-+'){l - cq^+^) E^+i + < 



-c';\c'„c-iag-2"(l - cq^/a){l - q^) E^-i, 
The symmetricity of the matrix of the operator J in the basis {S^, S^} means that 



(7.4) 
(7.5) 



-1 „ „-2n-i^^ _ aq^+i-^(l - afeg'^+Vc) = c-^c„+ig-2"-2(l - aq''+^/c){l - g"+i) 



c'-l,c'nq-'^-\l - bq^+^){l - cq^+') = c';'c'„+ig-2-2(l - cq^+^/a){l - q^+^). 



that is, 



Thus, 



(1 - ag")(l - abq-^/c) 



Cn-l 



Cn — C 



(1 - g")(l - ag"/cj c: 

niabq/c, aq;q)nY^'^ 



J 

n-l 



{aq/c,q;q)n 
where C and C are some constants. 



, dn = C'[q 



(1 - cg")(l - bq^) 
'(l-9")(l-cg"/a) 

I ibq,cq;q)n 
(cg/o, q; q)n 
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Therefore, in the expansions 

tpaqn{x) = En{x) = ^ Cn PmiaQ^) fLi^) = ^ amnfLix), (7-6) 

m m 

4,n(x) = = ^ < fl{x) = «mn fmi.x), (7.7) 

m m 

the matrix M := {dmn Qmn) with entries 

a =c P (aq^) - C ( ^^^^/^' "^^^ ~ Q^g^"""*"^) A ^'^^ 

""^ " ™ V {aq/c,q;q)n {abq/c,bq,q;q)m - abq){-ac)'^ J 

X (-+3)/4 . c; g) , (7.8) 

_ /9 _ --^/ / n {bq,cq;q)n {abq,aq,cq;q)„i{l - abq'^"'^^) ^^^'^ 

^mn — CnPm{Cq j — O I Q 



((cg/a, g; g)n (abg/c, 6g, g; q)m (1 - abq){-acy 

X g— (cg"+i ; a, 6, c; g) , (7.9) 

is unitary, provided that the constants C and C are appropriately chosen. In order to calculate 
these constants, one can use the relations 



\^mn\ — 1 ) \^mn\ ~ ^ ' 



m=0 m=0 

for n = 0. Then these sums are multiples of the sums in (7.2) and (7.3), so we find that 



^ ^ (bq, eg; g)^^ ^ {aq,abq/c; g)^^ 

{abq^,c/a;q)]^ {abq^ , a / c\ qfj^ 



The coefficients c„ and in (7.6)-(7.9) are thus real and equal to 



(6g, eg; g)oo (a6g/ c, ag; g)n g" \ d - ( ("g' "^^/'^^ ^)°° (^g^ ^9? g)n g^ V^^ 

{abq^,c/a;q)oo {aq/c,q\q)n ) ' " V (o^g^^ a/c; g)oo icq/a,q;q)n J 



The orthogonality of the matrix M = {cLmn (^mn) means that 

^ ^ O-mnO-mn' — ^nn' i ^ ^ ^mn^mn' ~ ^nn' j ^ ^ ^mn.O'rnn' ~ ^i (7-11) 



m 



^ ], {0'mnO'm'n "I" ^mnflm'n) — ^mm' ■ (7-12) 

n 

Substituting the expressions for CLmn and into (7.12), one obtains the relation 

(bg, eg; g)oo ^ (ag, a6g/e; g)ng" ^ r.^n+Up /„„n+ix 
{abq\c/a\q)oo ^ {aq/c,q;q)n 



, iaq,abq/c;q)^ ^ ibq^cq]q}nq^ ^.„n+Up ^,^n+u 
{abq^,a/c;q)oo ^ [cq/a,q;q)n 
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{l-abq){bq,abq/c,q;q)m , „ ^m m(m+3)/2 e .7 .on 



(1 - a6g2"i+i)(aq, ahq, cq; q)r 

This identity must give an orthogonality relation for the big q'-Jacobi polynomials Pmiv) = 
Pm{y;a,b,c;q). An only gap, which appears here, is the following. We have assumed 
that the points og" and eg", n = 0, 1,2,---, exhaust the whole spectrum of the oper- 
ator I2. As in the case of the operator Ji in section 4, if the operator I2 would have 
other spectral points Xk, then on the left-hand side of (7.13) would appear other summands 
A^Xfc -fm (a^fc ; CL, b, c; q)P„i' [xk'-. a, b, c: q), which correspond to these additional points. Let us show 
that these additional summands do not appear. To this end wc set m = m' = in the relation 
(7.13) with the additional summands. This results in the equality 

{bq,cq;q)oo {aq,abq/c;q)nq'^ 



{abq'^, c/ a; q) 00 {aq/c,q;q)n 



{aq,abq/c;q)oo {bq,cq;q)nq'' ^ 
^{abq\alc-qU t'o i^9/a,q;q)n V ^"^^ 



In order to show that J2k l^-^k — 0' ^^^'^ i^^^ account the relation 

(Aq/CBq/C-q), 



{q/C,ABq/C-q) 
{A,B;q)^ 



2MA,B;C; q,q) 



2MAq/C,Bq/C-q'/C; q,q) = l 



iC/q,ABq/C;> 

(see formula (2.10.13) in [15]). Putting here A = aq, B = abq/c and C = aq/c, we obtain 
relation (7.14) without the summand ^^k- Therefore, in (7.14) the sum |J,x^. does really 
vanish and formula (7.13) gives an orthogonality relation for big g-Jacobi polynomials. 

By using the operators I2 and J, we thus derived the orthogonality relation for big g-Jacobi 
polynomials. 

The orthogonality relation (7.13) for big g-Jacobi polynomials enables us to formulate the 
following statement: The spectrum of the operator I2 coincides with the set of points aq^'^^ 
and cq^'^^ , n = 0, 1, 2, • • •. The spectrum is simple and has one accumulation point at 0. 

8. Dual big g-Jacobi polynomials 

Now we consider the relations (7.11). They give the orthogonality relation for the set of 
matrix elements a^n and a'mni viewed as functions of m. Up to multiplicative factors, they 
coincide with the functions 

F„(x;a,6,c;g) := 302(x,a5g/x,ag"+^; ag,cg; g,g), n = 0,l,2,---, (8.1) 

F^(x;a,6,c;g) := 3^2(a;,a6g/x,cg"+^; ag,cg; g, g) = F„(x; c, 06/c, a), n = 0,l,2,---, (8.2) 
considered on the corresponding sets of points. Namely, we have 

. ^ f ni"M/c,aq;q)n {a.bq,aq,cq;q)m{l - abq'^"^+^^ ^ 

Omn = amn{a,b,c) = C (q 



aq/c, g; g)„ {abq/c, bq, q; q)m (1 - abq){-acy 
xg-m(m+3)/4 F„{q-'^; a, b, c; g), (8.3) 
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hcq;q)n {abq,aq,cq;q)m {I - abq'^"'-^'^) \^^'^ 



(cq/a, q; q)n (abq/c, bq, q; q)m (1 - abq){-ac) 



(8.4) 



where C and C are given by formulas (7.10). The relations (7.11) lead to the following 
orthogonality relation for the functions (8.1) and (8.2): 



{bq, eg; q)oo 
{abq'^,c/a;q)c 



J2 p{m)Fn{q "'•,a,b,c;q)F^,{q "'■a,b,c;q) 



m=0 



{aq/c,q;q)n 
{aq, abq/c; q)nq' 



-5nn', (8-5) 



{aq, abq/c; q)oo / xc^// -m , ^ w . , n {cq/a,q;q)n . „^ 
2 — 7 N— 2^ ;a,b,c;q)F^,{q ;a,b,c;q) = ^^f^nn', (8.6) 



{abq 



where 



p{m) : 



{bq, cq; q)nq'^ 
^ p{m)Fn{q~"';a,b,c;q)F^,{q~'^;a,b,c;q) =0, 

(1 - a6g2™+i)(ag, abq, cq; q)m 



(8.7) 



m=0 



-m(m+3)/2 



(1 - abq){bq, abq/c, q; q)m {-ac)"^ 

There is another form for the functions Fn{q~"^; a,b, c; q) and F^{q'~'^;a,b,c;q). Indeed, 
one can use the relation (III. 12) of Appendix III in [15] to obtain that 



Fn{q "';a,b,c;q) 



{cq '^/ab;q) rn ^^^^m+i^™ 

{cq; q)m 



-{abq"'+^r z4>2 



-"',abq"'+^,q-"' 
aq, abq/c 



q,aq^+^/c 



{abq/c; q)m , ^jm^m(m+l)/2 

{cq; q)m 
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q-'^,abq'^+'^,q-'' 
aq, abq/c 



q,aq^+'/c 



and 



F^(g-™;a,6,c;g) = (^^(_a)-g-{- 

{aq; q)m 



+iy2^^jQ-"',abq"'^\q-^ 
bq,cq 
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q,cq^+^/a 



The basic hypergeometric functions z(t^2 in these formulas are polynomials in n{m) := q ^ + 
ab . So if we introduce the notation 



then 



-D„(/i(m);o,6,c|g) := 3^2 
{abq/c; q) 



Fn{q "';a,b,c;q) = 



F'^{q-^;a,b,c;q) 



{cq;q)r 
{bq; q)r 



q, aq""^ c , 
aq, abq/c ) 

.{-crq"^(^+mD^^p{m);a,b,c\q), 



.{-a)'^q"'('^+^)/'^DMm);b, a, ab/c\q). 



{aq;q)r 

Formula (8.5) directly leads to the orthogonality relation for the polynomials Dn{lJ'{m)) = 
Dn{li{m);a,b,c\q): 

^ (1 - abq^^+^){aq, abq, abq/c; q)m m m(m-i)/2 ^ (^(^^^^ ,(a(m)) 

{l-abq){bq,cq,q;q)m ^ ^'^^ ^ Dn{p{m)) D^,{i,{m)) 
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_ {abq^,c/a;q)oo (aq/c,q;q)n ^ ^ 
{bq, cq; q)oo (aq, abq/c; q)nq"' 

Prom (8.6) one obtains the orthogonality relation for the polynomials Dn{lJ.{m);b,a,ab/c\q) 
(which follows also from the relation (8.9) by interchanging a and b and replacing c by ab/c). 

We call the polynomials Dn{lJ'{m);a,b,c\q) dual big q-Jacobi polynomials. It is natural to 
ask whether they can be identified with some known and thoroughly studied set of polynomials. 
The answer is: they can be obtained from the g-Racah polynomials Rn{tJ-{x);a,b,c,d\q) of 
Askey and Wilson [29] by setting a = q~^~^ and sending N ^ oo, that is, 

DnilJ^{x);a,b,c\q) = lim RniiJ,{x);q'''^~^ , a/ c, a, b\q). (8.10) 

iV— >c» 

Observe that the orthogonality relation (8.9) can be also derived from formula (4.16) in [30]. 
But the derivation of this formula (4.16) is rather complicated. 

It is worth noting here that in the limit as c — >^ the dual big g-Jacobi polynomials 
Dn{iJ,{x);a,b,c\q) coincide with the dual little gi-Jacobi polynomials dn{lJi{x);b,a\q), defined 
in section 5. The dual little g-Jacobi polynomials dn{^i{x)■, a,b\q) reduce, in turn, to the Al- 
Salam-Carlitz II polynomials Vn"'\s;q) on the (/-linear lattice s = q~^ (see [19], p. 114) in 
the case when the parameter b vanishes, that is, 

d„(/x(x);a,o|g) = 20o(r", g-";-; g,g7«) = (-a)-"g"("-i)/2Fi«)(g-";g)- (8.11) 

This means that we have now a complete chain of reductions 

Rn{l^{xy,a,b,c,d\q) — > Dn{li{x);b,c,d\q) —> dn{li{x);c,b\q) -—-^V^''\q~'';q) 

a— >oo a— >0 0=0 

from the four-parameter family of q-Keucdh polynomials, which occupy the upper level in 
the Askey-scheme of basic hypcrgeometric polynomials (sec [19], p. 62), down to the one- 
parameter set of Al-Salam-Carlitz II polynomials from the second level in the same scheme. 
So, the dual big and dual little qf-Jacobi polynomials D„(/x(a;); a, 6, c|g) and d„(//(a;); a, 5|g) 
should occupy the fourth and third level in the Askey-scheme, respectively. 

The recurrence relations for the polynomials Dn{p,{m) = £)„(/x(m); a, 6, c|g) are obtained 
from the g-difference equation (6.6). It has the form 

(g— _ i)(i _ abq"'+')DMm)) = ^„L>„+i(/x(m)) - (A„ + C„)L>„(/x(m)) + C„Z?„_i(/x(m)), 
where 

An = {l- aq^+'){l - cq^+'), C„ = aq{l - q^){b - cq^. 
The relation (8.7) leads to the equality 

g (1 - a6g^-+i)(a6g; qU ^mim-m DMm);a, b, c\q) D„, (^.(m); b, a, abq/c\q) = 0. 

(8.12) 

We give an alternative proof of this result in Appendix. 

Note that from the expression (8.8) for the dual big g-Jacobi polynomials £)„(/x(m); a, b, c\q) 
it follows that they possess the symmetry property 

Dn{n{m);a, b, c\q) = Dn{n{m);ab/c, c, b\q). (8.13) 
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The set of functions (8.1) and (8.2) form an orthogonal basis in the Hilbert space P of 
functions, defined on the set of points m = 0, 1, 2, • • •, with the scalar product 



if I, h) = X] ^("^) -^i^"^) /2('^)' 

m=0 

where p{m) is the same as in formulas (8.5)-(8.7). Consequent from this fact, one can deduce 
(in the same way as in the case of dual little g-Jacobi polynomials) that the dual big q- 
Jacobi polynomials Dn{iJ,{m);a,b,c\q) correspond to indeterminate moment problem and the 
orthogonality measure for them, given by formula (8.9), is not extremal. 

It is difficult to find extremal measures. As far as we know, explicit forms of extremal 
measures have been constructed only for the g-Hermite polynomials with q> 1 (see [31]). 

9. Generating functions 

Generating functions are known to be of great importance in the theory of orthogonal 
polynomials (see, for example, [16]). For the sake of completeness, we briefly discuss in 
this section some instances of linear generating functions for the dual qf-Jacobi polynomials 
Dn{^J'{x);a,b,c\q) and d„(/Lt(x); a, 6|g). To start with, let us consider a generating-function 
formula 

f (pif rz>„(Mx);a.6,*) = <f^lfl^.fc(\"';''7 P-D 

{l^Qh {t;q)oo V <^bq/c, aqt ) 

where \t\ < 1 and, as before, fi{x) = q~^ + abq^^^. To verify (9.1), insert the explicit form 
(8.8) of the dual big g-Jacobi polynomials 

n w ^ u \ \ A (g"'',a6g=^+\g-";g)fe /ag'"+^^ 

Dn[n[x);a, b, c\q) = > — — r 

^ {aq,abq/c,q-q)k \ c 

into the left side of (9.1) and interchange the order of summation. The subsequent use of the 
relations 

{a;q)m+k = {a;q)m{aq"^;Q)k = {a;q)k{aQ'';q)m, 
{q-"'-'';q)k = i-l)\-"'''-''^''+'^/\q"'+^;q)k 

(see [15] , Appendix I) simplifies the inner sum and enables one to evaluate it by the q'-binomial 
formula (4.9). This gives the quotient of two infinite products in front of 202 on the right side 
of (9.1), times {aqt;q)~^^. The remaining sum over k yields 2</'2 series itself. 

As a consistency check, one may also obtain (9.1) directly from the generating function 
for the Q'-Racah polynomials i?„(//(x); q, /3, 7, (5|g) (see formula (3.2.13) in [19]) by setting 
a = q~^~^ and sending iV — 00. This results in the relation 

^ {Q;Q)n {t;q)oo V <^bq/c ) 

The left side of (9.2) depends on the variable x by dint of the combination /i(x) = q~^ ^ab(f^^ . 
Off hand, it is not evident that the right side of (9.2) is also a function of the lattice /i(x). 
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Nevertheless, this is the case. Moreover, the right sides of (9.1) and (9.2) are equivalent: this 
fact is known in the theory of special functions as Jackson's transformation 

2^1(0,6; c; q,z) = 2<l>2{a,c/b; c,az; q,bz) 

{^'j Q)oo 

(see, for example, [15]). 

The symmetry property (8.13) of the dual big g-Jacobi polynomials Dn{n{x);a,b,c\q), 
combined with (9.1), generates another relation 



^ {abq c;q)n,n^ , , . , , x {abqt/c;q)oo , [q , abq^+^ \ 

Z^—f X 1 Dnin{x);a,b,c\q) = — 7-^; 2^2 , , , q, aqt c] 

^ {Q;Q)n {t;q)oc, V abqt/c ) 

{q-\ b-\-- abtq^+^/c) . (9.3) 
\ aq J 



n=0 

_ {abtq''+^/-"^ ^"-^ A-i^-^ 

Similarly, a generating function for the dual little g-Jacobi polynomials has the form 



^.J^^"'^ ^n(Mx);a,%) = (,,,,.,)^ • (9-4) 



n=0 



One can verify (9.4) directly by inserting the explicit form (5.4) of dn{lJ^{x);a,b\q) into the 
left side of (9.4) and repeating the same steps as in the case of deriving (9.1). This will lead 
to the expression 

■2'?!'i(g"^, a6g^+^ abqt; q,t) 



{at; q)c 

and it remains only to employ Heine's summation formula (1.5.1) from [15]. After a simple 
rescaling of the parameters the generating function (9.4) coincides with that, obtained earlier 
in [24]. 

The simplest way of obtaining (9.4) is to send c — > in both sides of (9.2): the 2^1 series 
on the right side of (9.2) reduces to i(/!'o((?~^; — ; (l,t/a), which is evaluated by the g-binomial 
formula (4.9). 

Finally, when the parameter b vanishes, (9.4) reduces to the known generating function 

^0 {at,t;qU 
for the Al-Salam-Carlitz II polynomials (see (3.25.11) in [19]). 
10. Concluding remarks 

To summarize, we have attempted to carry over, by using the discrete series representations 
of the quantum algebra Uq{sui^i), an idea of the duality of polynomials, orthogonal on a finite 
set of points, to the case of big and little g-Jacobi polynomials. 

In fact, we used this idea in [6] and [8] to show that Al-Salam-Carlitz II polynomials are 
dual with respect to little g-Laguerre polynomials and g-Meixner polynomials axe dual to big 
g-Laguerre polynomials, respectively. 

This approach may be further explored and applied to other g-polynomials families. In 
particular, we know that it is possible to show, by using certain irreducible representations 
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of the quantum algebra [/^(sui^i) (which are not *-representations of [/^(sui^i)), that poly- 
nomials, dual to g-Charlier pol3momials (see formula (3.23.1) in [19]), are Al-Salam-Carlitz 
polynomials I (see formula (3.24.1) in [19]) and polynomials, dual to the alternative g-Charlier 
polynomials 

Kn{x;a;q) := ■2(pi{q''',-ac/'; 0; q;qx), n = 0, 1,2,---, 
(see formula (3.22.1) in [19]), are the polynomials 

cZ^(/x(n); a; q) = sMq'"", 9"'"; -; 9, -g'^/a), m = 0, 1, 2, ■ • • , 

where /x(n) = g"" — ag". The orthogonality relation for them has the form 

Proofs of these statements will be given in a separate publication. 
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Appendix 

In this appendix we prove the summation formula 

y> {abq,bq;q)n 1 - a&g^"+^ ^„^„2 _ {abq^-q)^ 
{aq,q;q)n I - ahq {aq]q)oo 

First of all, observe that when 6 = this relation reduces to 

a"q''' 1 



oo 



E 

n=0 



{aq, q; q)n (aq; q) 

CO 



which is a well-known limiting form of Jacobi's triple product identity (see [15], formula 
(1.6.3)). 

One can employ an easily verified relation 

{aq,-aq;q)n ^ 1 - a^g^^ ,^ 
{a,-a;q)n 1 - 

in order to express the infinite sum in (A.l) in terms of a very- well-poised 4^5 basic hyperge- 
ometric series. This results in 



(a6g, 6(7; g)n 1 — a6(? ^ ^„^„2 _ ^ / abq, bq, q\/abq, —q^/abq 
{aq,q;q)n 1 — abq \ aq, \/abq, —\/abq, 0, 



q,aq] . {A.S) 
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The next step is to utilize a limiting case of Jackson's sum of a terminating very-well-poised 
balanced s(t^7 series, 



6^5 



a, gi/a, -Qy/a, b, c, d 
•\/a, —y/a, aq/b, aq/c, aq/d 



aq\ {aq,aq/bc,aq/bd,aq/cd;q)oo 
bed J {aq/b, aq/c, aq/d, aq/bcd;q)oo^ 



(AA) 



which represents a (/-analogue of Dougall's formula for a very- well-poised 2-balanced ^Fq series. 
When the parameters c and d tend to infinity, from (A.4) it follows that 



4<?>5 



a, qy/a, -qy/a, b 
i/a, -^/a, aq/b, 0, 



aq 



(Qg;g)oo 

{aq/b; q)oo ' 



{A.5) 



To verify this, one needs only to use the limit relation 



c.d— >oo 



With the substitutions a abq and 6 —> 6(7 in (A.5), one recovers the desired identity (A.l) 
Similarly, when d — > 00 we derive from (A.4) the identities 



(1 — a6g^"'+^)(ag, abq/c, abq; q)r 



„ (I -a 



n=0 



(1 - abq){bq,cq,q;q)n{-a/cY 



-q 



,n(n-l)/2 



{abq^,c/a;q)c 
{bq, cq; g)oo 



^„ (1- 



(1 - abg^"+^)(a6g, bq, cq; g)„ „(n-i)/2 ^ {abq^,a/c; q) 



n=0 



(1 - abq){aq, abq/c,q;q)n{-c/aY 



{aq, abq/c; q) 



00 
00 



{A.6) 
{A.7) 



They have been used in section 7. 

We conclude this appendix with the following remark. There is another proof of the 
identity (8.12), based on vital use of the same summation formula (A.4). Actually, a relation 
may be derived, which is somewhat more general than (8.12). Indeed, consider the function 



00 ^ 
{a;q) := ^^(-l)^^"-^)/^^ 



M («; a) 



{A.8) 



n=0 



m {q', q)n 

for arbitrary nonnegative integers k, where the g-quadratic lattice ii{n; a) is defined as before: 

/x(n;a) :=g-" + ag"+\ (A9) 

We argue that all rjk{a; q) = 0, = 0, 1, 2, • • •. To verify that, begin with the case when A; = 
and employ relation (A. 2) to show that 



770(0; 9) = 



q^aq, -q^aq, aq 
aq, -Vaq, 



The summation formula (A.4) in the limit as d — > 00 takes the form 



595 



a, q^/a, -q^/a, b, c 
■s/a, — v/a, aq/b, aq/c, 



aq 



{aq,aq/bc; q)c 



be J {aq/b, aq/c; q)c 
In the particular case when be = aq this sum reduces to 



(^.10) 



3<P3 



a, q^, -q\/a 
0, v^, — 



{aq,l;q)oo „ 

9, 1 = -77 X — =0, 

(0, c; q)oo 
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since {z; q)^^ = for z = 1. Consequently, the function r]o{a; q) does vanish. 

For k = 1,2,3, one can proceed inductively. Employ the relation qfj,{n + l;a) = 
fi{n; q^a) to show that 

?7fc+i(a; q) = (1 + aq)rik{a; q) - q''''~^{l - aq^){l - aq^)7]k{aq^] q). 

So, one obtains that indeed all r]k{a;q), k = 0, 1,2, vanish. The identity (8.12) is now 
an easy consequence of this statement if one takes into account that a product of the two 
polynomials Dn{iJ,{m);a,b,c\q) and Dn/{fx{m);b,a,abq/c\q) in (8.12) is some polynomial in 
/7,(m) of degree n + n'. This completes the proof of (8.12), which is independent of the one, 
given in section 8. 
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